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Abstract 

Stochasticity is both exploited and controlled by cells. Although the intrinsic stochasticity inher- 
ent in biochemistry is relatively well understood, cellular variation is predominantly generated 
by interactions of the system of interest with other stochastic systems in the cell or its envi- 
ronment. Such extrinsic fluctuations are non-specific, affecting many system components, and 
have a substantial lifetime comparable to the cell cycle (they are 'colored'). Here we extend 
the standard stochastic simulation algorithm to include extrinsic fluctuations. We show that 
these fluctuations affect mean protein numbers and intrinsic noise, can speed up typical network 
response times, and explain trends in high-throughput measurements of variation. If extrinsic 
fluctuations in two components of the network are correlated, they may combine constructively 
(amplifying each other) or destructively (attenuating each other). Consequently, we predict that 
incoherent feedforward loops attenuate stochasticity, while coherent feedforwards amplify it. Our 
results demonstrate that both the timescales of extrinsic fluctuations and their non-specificity 
substantially affect the function and performance of biochemical networks. 
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Introduction 



Biochemical networks are stochastic: fluctuations in numbers of molecules are generated intrin- 
sically by the dynamics of the network and extrinsically by interactions of the network with 
other stochastic systems (Elowitz et al., 2002; Swain et al., 2002). Stochastic effects in protein 



numbers can drive developmental decisions (Arkin et al., 1998 Suel et al., 2007; Maamar et al., 



2007 Nachman et al., 2007), be inherited for several generations (Rosenfeld et al., 2005 Kauf- 



mann et al., 2007), and have perhaps influenced the organization of the genome (Swain, 2004 



Becskei et al., 2005). Intrinsic fluctuations are generated by thermal fluctuations affecting the 



timing of individual reactions. Their magnitude is increased by low copy numbers. The source 
of extrinsic fluctuations, however, is mostly unknown (Kaern et al., 2005), although cell cycle 
effects (Rosenfeld et al., 2005 Volfson et al., 2006) and upstream networks (Volfson et al., 2006) 



contribute. Yet extrinsic fluctuations dominate cellular variation in both prokaryotes (Elowitz 



et al., 2002 ) and eukaryotes (Raser and O'Shea, 2004). They are colored, having a lifetime that is 



not negligible but comparable to the cell cycle (Rosenfeld et al., 2005), and they are non-specific, 
potentially affecting equally all molecules in the system (Pedraza and van Oudenaarden, 2005). 



They are thus difficult to model and their effects hard to predict (Volfson et al., 2006; Sigal 



et al., 2006| |Geva-Zatorsky et al., 20061 |Austin et al., 2006] |Cox et al., 20061 |Tsimring et~ai; 



2006 Scott et al., 2006 Tanase-Nicola et al, 2006). 



Intrinsic and extrinsic stochasticity can be measured by creating a copy of the network of 
interest in the same cellular environment as the original network (Elowitz et al., 2002). We 
can then define intrinsic and extrinsic variables, and their fluctuations generate intrinsic and 
extrinsic stochasticity, or noise (Swain et al., 2002). Intrinsic variables typically specify the 
copy numbers of the molecular components of the network. Their values differ for each copy of 
the network. Extrinsic variables often describe molecules that equally affect each copy of the 
network. Their values are therefore the same for each copy. Considering gene expression, the 
number of transcribing RNA polymerases is an intrinsic variable (it is different for each copy of 
the network), whereas the number of cytosolic RNA polymerases is an extrinsic variable (both 
copies of the network are exposed to the same cytosolic RNA polymerases). 

Noise is quantified by measuring an intrinsic variable, for example, the number of proteins, 
for both copies of the network. Fluctuations of the intrinsic variable will have intrinsic and 
extrinsic components: intrinsic variables are themselves part of a stochastic system and that 
system interacts with other stochastic systems. Throughout we will use the term 'noise' to 
exclusively mean a measure of stochasticity, usually the coefficient of variation. Experimentally, 



the relative number of proteins can be quantified in living cells using fluorescent proteins (Elowitz 



et al., 2002 Raser and O'Shea, 2004 Ozbudak et al., 2002 Blake et al., 2003). Denoting h 



as the intrinsic variable (the number of proteins) for the first copy of the system and I2 the 
equivalent for the second copy, then intrinsic noise is determined by a measure of the difference 
between I x and I2 because intrinsic fluctuations cause variation in Ii to be uncorrelated with 
that of J2. Extrinsic fluctuations, however, cause variation in I\ and I2 to be correlated because 
they equally affect both copies of the system. Extrinsic noise is a measure of this correlation 
and is determined by the cross-correlation function of l\ and li- The squares of the intrinsic 
and the extrinsic noise sum to give the square of the total noise of the intrinsic variable, which 
is defined as its coefficient of variation (Swain et al., 2002). 

Here we consider the effects of extrinsic fluctuations on biochemical networks. Extrinsic 
fluctuations typically cause fluctuations in the parameters of a network (Paulsson, 2004). For 
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example, Fig. [T^i shows a model of gene expression that includes promoter activation, tran- 



scription, translation, and degradation (Kepler and Elston, 2001 Kaern et al., 2005; Raser and 



O'Shea, 2004 Golding et al., 2005). In this model, v\ is the rate of translation. It is a function 
of the number of free ribosomes, an extrinsic variable, and will fluctuate as the number of free 
ribosomes changes. Extrinsic fluctuations have an average lifetime that is not zero (they are 



'colored') (Rosenfeld et al., 2005). We will show that this extrinsic timescale can profoundly 
affect the system's dynamics and stochastic properties. It can determine the lifetime of protein 
fluctuations and change mean protein numbers. Extrinsic fluctuations being non-specific can 
act simultaneously on many parameters of the network. This non-specificity can cause fluctua- 
tions to combine constructively or destructively, dramatically altering the network's output. For 
our simulations, we designed a novel extension of the standard algorithm for simulating intrinsic 



fluctuations (Gillespie, 1976) that includes discontinuous, time- varying parameters and therefore 



can simulate extrinsic fluctuations with any desired properties (Materials and methods). 
Results 

Extrinsic fluctuations alter mean protein numbers and intrinsic noise 

Extrinsic fluctuations can substantially change the distribution of protein numbers. Fig. [T]d 
shows the steady-state distribution of protein numbers for the model of Fig. [T^, with no extrinsic 
fluctuations. It is slightly asymmetric and is expected to approximate a gamma distribution 
(Friedman et al., 2006). Fig. shows the corresponding joint probability distribution of I\ 



and J 2 . Although the system is generally described by a probability distribution that includes 
all the intrinsic variables for the first copy of the network, all the intrinsic variables for the 
second copy, and all the extrinsic variables, a projection of this distribution onto l\ and I2 



is sufficient for calculating noise (Elowitz et al., 2002). With no extrinsic fluctuations, the 
distribution spreads parallel to the I\ and I 2 axes (Fig. [Tp): I\ and I 2 are independent and have 
no correlation (rj ext = 0). With extrinsic fluctuations, the mode and mean of the distribution 
of protein numbers can decrease, its variance increases, and there can be a longer tail at high 
numbers (Fig. [TJl). Correspondingly, the probability distribution for I\ and I 2 spreads along the 
line I\ — I2: Ji and I2 are now correlated through fluctuations in the extrinsic variable (here, the 
rate k : Fig. [T|i inset). Higher extrinsic noise would cause the distribution to spread along and 
tighten around the line I\ = Ii- Higher intrinsic noise would cause the distribution to expand 
away from the line. 

Changing the properties of extrinsic noise, its source, its magnitude and the typical lifetime 
of an extrinsic fluctuation (r), can alter mean protein numbers and the intrinsic noise. The effect 
of extrinsic fluctuations is determined by both their coefficient of variation and their lifetime. As 
the coefficient of variation of any parameter in Fig. [T^, increases, the extrinsic noise in protein 
numbers increases (Fig. [2^,). Similarly, as the lifetime of extrinsic fluctuations increases, the 
extrinsic noise increases: extrinsic fluctuations that are fast compared to intrinsic fluctuations 
are averaged away and contribute little extrinsic noise (Fig. [2Jd). If the extrinsic fluctuations 
occur in a parameter that determines the lifetime of fluctuations in protein numbers, such as 
the protein degradation rate, then the extrinsic timescale mixes with the intrinsic timescales 
and the mean (and the mode) of the protein distribution can shift (Fig. ^ and[2jl). Although 
this change in mean protein numbers implies that extrinsic fluctuations can change intrinsic 
noise, the change we observe is more than expected (Fig. [2^ and [2}:): if the translation rate, 
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Vi, fluctuates, the mean protein number changes little, but there is over a twofold increase in 
intrinsic noise. To understand this behavior, consider only the measured intrinsic variables and 
one extrinsic variable, E say, then the system can be described by the probability distribution 
P(Ii, l2,E). Changing the properties of the extrinsic variable will change the shape of this three 
dimensional distribution and consequently its projection onto the I\ and I2 plane (Supplementary 
information). The intrinsic noise, which is determined by the I\ and I2 projection, can therefore 
vary with extrinsic fluctuations. We mathematically verified these conclusions for the model of 
Fig. [l^, (Fig. [2] and Supplementary information). 

Our approach also provides a general technique for stochastic sensitivity analysis because we 



apply fluctuations to parameters of the system (Stelling et al., 2004). We can therefore determine 



for example, the robustness of the concentration of the network output or any other network 
property to changes in parameter values. Sensitive parameters generate both a high intrinsic 
and a high extrinsic noise (a high total noise) in the property under investigation. Within our 
model, we predict that protein levels are most sensitive to fluctuations in the transcription and 
translation rates, vq and v\ (Fig. [2^ and Fig. |2^). 

Extrinsic fluctuations can describe trends in high-throughput measurements 

We can use these properties of extrinsic fluctuations to explain high-throughput measurements of 
stochasticity. Total noise in protein numbers scales with the inverse square root of mean protein 



number (Bar-Even et al., 2006; Newman et al., 2006). Bar-Even et al. neglected extrinsic noise 



to explain this relationship, which is expected for intrinsic noise (Bar- Even et al., 2006). We 
generated many models from the scheme of Fig. [IJi by log-normally sampling its parameter set 
(Materials and methods). We simulated these models with substantial extrinsic fluctuations and 
found that the scaling is still apparent, because extrinsic fluctuations can change mean protein 
numbers and intrinsic noise (Fig. [3k). Our results imply that the high throughout measurements 



are consistent with other work which shows extrinsic noise to be dominant (Elowitz et al., 2002 



Raser and O'Shea, 2004[ ). 

Extrinsic fluctuations can cause correlations between the lifetime of protein fluctuations and 
the extrinsic noise in protein levels, if they have the longest timescale in the system. The lifetime 
of protein fluctuations will then be determined by the lifetime of the extrinsic fluctuations. With 
the same simulations, we measure a significant correlation between the timescale of protein 
fluctuations and total noise (Fig. [3]d). It arises because many of the models we simulate have 
extrinsic noise greater than intrinsic noise. The correlation is also evident in Fig. |2|d. Indeed, 
time series studies in human cells have shown that the total noise to be correlated with the 



autocorrelation time of protein levels (Sigal et al., 2006). 



Extrinsic fluctuations can affect the performance of genetic networks 

We next considered the effect of extrinsic fluctuations on one of the simplest regulatory networks: 
a negatively auto-regulated loop. Experiments suggest that total noise is attenuated by negative 



auto-regulation, at least for a plasmid-borne system (Becskei and Serrano, 2000). Negative 
feedback reduces noise by increasing expression when protein numbers are low and decreasing 
expression when protein numbers are high. It also, however, reduces mean protein numbers. This 
reduction in protein copy numbers amplifies intrinsic noise and may surpass any attenuating 
effects (Fig. |4^i and |4]d). Extrinsic noise is mostly independent of protein numbers. It will 
therefore decrease with the addition of negative feedback. Consequently, the total noise of a 
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constitutive system to which auto-negative feedback is added can either increase or decrease if 
intrinsic or extrinsic noise is larger (Fig. |4^i and Hp). Consistently, experiments show a range 
of auto-repression strength for which noise minimization is optimal, although this observation 
was attributed to plasmid variation (Dublanche et al., 2006). Our results suggest extrinsic 
fluctuations in any parameter of the system should create the same effect. We also predict 
that negative feedback is more likely to evolve as a noise attenuator in systems dominated by 



extrinsic noise (Paulsson, 2004; Hooshangi and Weiss, 2006). Alternatively, intrinsic fluctuations 



could be reduced by an additional positive feedback loop to maintain high protein copy numbers 
despite the negative feedback needed to attenuate extrinsic fluctuations. For example, positive 
and negative feedbacks occur in the GAL regulon in budding yeast and have been shown to 



reduce fluctuations (Ramsey et al., 2006). 



Negative auto-regulation also reduces response times (Savageau, 1974 Rosenfeld et al., 2002). 



The mean time for an auto-negative system to reach half of its steady-state number of proteins 
from the initiation of transcription, t r , is reduced by at least a factor of two by negative feedback 
(Fig. [J andgi). This reduct ion occurs because negative feedback decreases the timescales of the 
system and so shifts the power spectrum of a constitutively expressed gene to higher frequencies 
(Austin et al., 2006). More intuitively, negative feedback both reduces steady-state protein 



numbers from constitutive levels and initially allows expression at the higher constitutive rate 



while the first repressors are synthesized (Rosenfeld et al., 2002). Stochastic fluctuations can 



cause significant variation in timing (Amir et al., 2007), and we observe that the probability 



distribution of t r is asymmetric and the asymmetry is enhanced by extrinsic noise (Fig. |4j^ 
and|l]i). An extrinsic fluctuation can either aid or inhibit gene expression, and its substantial 
lifetime ensures that such effects contribute significantly to t r . Despite increasing the mean 
response time, extrinsic noise enables cells to typically respond faster, irrespective of negative 
feedback, because the most probable t r decreases (Fig. [4J: and[I]i). Yet, a population of cells can 
better 'hedges its bets' (Kussell and Leibler, 2005) because a greater number will rarely respond: 



the distribution has a longer tail for high response times. 



Extrinsic fluctuations can combine destructively and constructively 

Extrinsic fluctuations are non-specific: they can act simultaneously on many parameters of a 



network (Pedraza and van Oudenaarden, 2005). We added extrinsic fluctuations to all pairs of 
parameters in the model of Fig. [T^i. These fluctuations were either uncorrelated, and generated 
by individual noise sources, or identical, and generated by the same noise source (Fig. [5^ and 
[5}d). For uncorrelated extrinsic fluctuations, the extrinsic noise in each parameter combines con- 
structively: the extrinsic noise is approximately the sum of the extrinsic noises generated when 
each parameter fluctuates alone (Fig. [5^,). For identical or, more generally, correlated extrinsic 
fluctuations, the extrinsic noise in each parameter also combines constructively if both parame- 
ters affect protein numbers similarly (protein numbers are proportional or inversely proportional 
to both parameters). Extrinsic fluctuations can be destructive, however, if both parameters have 
opposing effects on protein numbers (protein numbers are proportional to one parameter and 
inversely proportional to the other). Fluctuations in the two extrinsic variables then have lit- 
tle effect on extrinsic noise because a fluctuation in the variable that acts to increase protein 
numbers is counteracted by the same, or a similar, fluctuation in the variable that acts to de- 
crease protein numbers (Fig. |5}d). A network architecture that channels extrinsic noise into two 
parameters with opposing effects on protein numbers can therefore attenuate noise, and one 
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that channels extrinsic noise into two parameters with similar effects on protein numbers can 
be a noise amplifier. We confirmed these results using a Langevin calculation (Supplementary 
information). 

Constructive and destructive extrinsic fluctuations occur in feedforward loops, one of the 
most common motifs in genetic networks (Milo et al., 2002). Fig. [5j? and [5]i illustrate two 
feedforwards, where gene Z is activated by genes X and Y, and gene Y is either activated by 
gene X (coherent feedforward) or repressed by gene X (incoherent feedforward) ( |Mangan and 
Alon, 2003). Extrinsic fluctuations in Y can combine constructively or destructively with those 



in X because the feedforward correlates the fluctuations of Y with the extrinsic fluctuations in X. 
If the timescale of the extrinsic fluctuations is less than intrinsic timescales, however, extrinsic 



fluctuations are averaged away and such effects are no longer seen (Ghosh et al., 2005 Hayot and 



Jayaprakash, 2005). In the coherent feedforward loop, the extrinsic fluctuations are constructive 

In the incoherent feedforward 



because X and Y affect gene expression of Z similarly (Fig. [5 
loop, X and Y having opposing affects on gene expression and their extrinsic fluctuations are 
destructive (Fig. [5]d) . As well as being sign-sensitive delays and accelerators (Mangan and Alon, 



2003[ ), feedforward loops may therefore also have been selected to amplify (coherent) or attenuate 
(incoherent) extrinsic fluctuations. 



Discussion 

Here we have extended the standard stochastic simulation algorithm for simulating intrinsic 



fluctuations in biochemical networks (Gillespie, 1976) to include extrinsic fluctuations (Materials 



and methods). Although extrinsic fluctuations have been modeled previously (Volfson et al., 
20061 ISigal et al., 20061 [Geva-Zatorsky et al., 20061 |Austin et al., 2006l[Cox~et al., 2006||Tsimring 
et al., 20061 Scott et al., 2006[ Tanase-Nicola et al., 2006), our approach is more general: we can 



simulate extrinsic fluctuations with any desired properties; we can vary many parameters with 
correlated or uncorrelated fluctuations; and we are able to average over intrinsic fluctuations 
by repeating simulations with the same trajectory of extrinsic variation. In the Supplementary 
information, we show that time-varying extrinsic fluctuations lead to a generalization of the 



original definitions of intrinsic and extrinsic noise (Swain et al., 2002). 



Both the magnitude and the timescales of fluctuations are necessary to predict the effects 
of one stochastic system interacting with another. The mixing of the timescales of the two 



systems through their interaction can lead to so-called deviant effects (Samoilov and Arkin, 



2006), such as a shifting of the mean and asymmetries in the distribution of protein numbers. 



Extrinsic fluctuations can even decrease intrinsic noise in protein levels. We predict that deviant 
effects will be common in biochemical networks because these networks typically have substantial 
extrinsic fluctuations and the timescale of these fluctuations can be the longest timescale in the 
system. Indeed, such effects are present in high-throughput measurements of cellular variation 



(Bar-Even et al., 2006 Newman et al., 2006 Sigal et al., 2006). 



We can use our simulation method to investigate the source of extrinsic fluctuations. Inter- 
preting our results as a stochastic sensitivity analysis, we predict that variation in transcription 
and translation rates to be the most significant sources. Such variation is likely to arise from 
fluctuations in the numbers of ribosomes and RNA polymerases. Being based on the parameter 
set of Fig. [T^l, this prediction is model-specific, but we expect it to hold for other genes in E. 
coli. 

Extrinsic fluctuations can create stochasticity in the output of a network of a magnitude 
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that is substantially different from the magnitude of the extrinsic fluctuations themselves. If 
correlated, fluctuations in two parameters of a network can combine constructively to create 
extrinsic noise in the protein output that is many times the extrinsic noise for each parameter 
fluctuating independently. A different network architecture, however, can cause correlated ex- 
trinsic fluctuations to almost entirely negate each other. Both effects are likely to be present in 
cells. 

Extrinsic fluctuations, through their timescales and non-specificity, are thus an important 
component of the intracellular environment. To function in this environment, biochemical net- 
works are likely to have evolved to control or exploit these fluctuations. Our stochastic simu- 
lation algorithm and mathematical analysis should therefore help to quantitatively understand 
endogenous networks and to design effective synthetic ones. 



Materials and methods 



To simulate extrinsic noise, we extend Gillespie's first reaction algorithm (Gillespie, 1976) to 
include discontinuous, time-dependent reaction rates. In the first reaction algorithm, a putative 
time for each potential reaction in the system is calculated, and the reaction whose putative time 
is first is implemented. Simulation time is then incremented by this reaction time. Each putative 
reaction time is calculated from the propensity of the reaction: the probability of the reaction 



per unit time multiplied by all ways of selecting the reactants (Gillespie, 1976). The propensity, 
a(t), is a function of time if the probability of the reaction per unit time is not constant. 

For a time-varying propensity, we can show (Supplementary information) that the putative 
reaction time, r, obeys 

r T 

dta(t) =log(l/r) (1) 



o 



where r is a uniform random number between and 1. Eq. [I] is general, but it may be difficult 
to analytically find r for a complex a(t). Consequently, we approximate a(t) by a series of step 
functions or a piecewise-linear function. If we sample a(t) every At seconds and use the more 
accurate piece-wise linear approximation, then a(t) ~ a + ait for t within a At interval. Here 
ao and a± are constants defined by the Taylor series of a(t) and will change discontinuously from 
one At interval to the next. We can use Eq. [I] to exactly implement discontinuous changes in a 
propensity (Supplementary information). Briefly, if the next predicted reaction would bring the 
simulation time into the next At interval, we do not implement this reaction, but instead change 
the time-dependent propensity to the new functional form valid for the new At interval. We set 
the simulation time to the start of the new At interval and re-calculate the putative reaction 
times for all the reactions. 

To calculate the putative reaction time within each At interval when a(t) = ao + a\t, we 
again use Eq. [T] which implies 




1 -^log(r)- l ) (2) 



2 

°»0 



where r obeys < r < At. If ai < and r > e^T , then the reaction cannot occur (r = oo). 

By generating a time series for an extrinsic noise source before running our algorithm, we can 
then use this time series to change reaction rates appropriately to simulate extrinsic fluctuations. 



7 



We use the Ornstein-Uhlenbeck process to generate the time series (Fox et al., 1988 Gillespie, 
1992). This process, r](t), has a positive autocorrelation time and is normally distributed. 
Consequently, when added to a parameter k so that k — ► k + rj(t), k can become negative. 
Exponentiating r)(t), however, and letting k — > ke v ^ / (e 71 ^) generates a log-normal stochastic 
process for k. Such a process is suitable for modeling fluctuations in extrinsic variables (Rosenfeld 



et al., 2005): k has a fixed mean, a finite auto-correlation time, and is always positive. 



We simulate with the Gibson-Bruck version of the Gillespie method ( Gibson and Bruck, 2000 ) 
using the Facile network compiler and its stochastic simulator (Siso-Nadal et al., 2007). Both are 
freely available. All reactions and kinetic rates are included in the Supplementary information. 



When simulating two copies of the system, we define rf[ 



2 

int 



and 77, 



2 

ext 



qi^)-(i) 2 



where 



2(/> 2 axlKX ''ext — (/}2 

l\ is the number of proteins for the first copy and I2 the number of proteins for the second copy. 
We use (Ii) = (I 2 ) = (I) because both copies have the same mean. In our simulations, averages 
are time averages taken over many times the longest timescale of the system. 

For Fig. [3j we generated parameter sets for our model of gene expression from log-normal 
distributions with means given by the parameter values in Fig. [pi and a variance in log-space of 
20% of the mean. We choose ko, however, by sampling the probability of the promoter being in 
the active state from a log-normal distribution with a mean given by the parameters in Fig. la 
and with a variance of 70% of this mean. We let extrinsic fluctuations act on a randomly chosen 
parameter in each model. These fluctuations have a coefficient of variation of 1. For each model, 
we sample r from a log-normal distribution with a mean of 2500s, the mean protein lifetime, 
and with a variance of 50% of this mean. 
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Figure 1: Extrinsic noise changes substantially the probability distribution for protein numbers 
during gene expression, a A model of gene expression with two states of the promoter, one active, 
and able to initiate transcription, and the other inactive. We have shown the binding of RNA 
polymerase (purple pentagon) driving the transition from active to inactive, but the transition 
may occur through the binding of transcription factors or changes in the structure of chromatin 
(Blake et al., 2003 Raser and O'Shea, 2004 Golding et al., 2005). Once active, the promoter 
can initiate transcription on average every 1/vq seconds and synthesize mRNA which in turn is 
translated into protein on average every l/v\ seconds. Both protein and mRNA undergo first- 
order degradation. We use parameters appropriate for Escherichia coli (Golding et al., 2005): 
k = 0.005 b _1 , fci = 0.03 s _1 , v = 0.07 s -1 , d = 0.005 s" 1 , v x = 0.2 s~\ and d x = 0.0004 
s _1 . The longest intrinsic timescale is then 2500s, the promoter is active approximately 15% 
of the time, and the mean steady-state number of proteins is 1000. b A histogram of protein 
numbers generated by stochastic simulation of a. Only intrinsic fluctuations are included. The 
distribution is slightly skewed with the mode close to the mean, which is shown by the green line, 
c A contour plot of the joint protein probability distribution generated by a two-color experiment 
for which we simulate two identical copies of the system, d A histogram of protein numbers 
generated from intrinsic Auctions and a fluctuating extrinsic variable: k , the probability per 
unit time of the promoter transitioning from the inactive to the active state. The inset shows 
typical variation of fcr> Extrinisic fluctuations are generated by a log-normal stochastic process 
with an autocorrelation time of approximately 10 3 s: the mean of ko is unchanged and it has a 
coefficient of variation of 1. e The corresponding joint probability distribution for Ii and 1 2 in 
a two-color experiment. 
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Figure 2: The effects of the magnitude of extrinsic fluctuations (the coefficient of variation) 
and their duration (the autocorrelation time r) on extrinsic noise (a and b), mean protein 
numbers (c and d), and intrinsic noise (e and f) for the gene expression of Fig. pji. We simulate 
fluctuations in either ko (orange circles), k\ (green squares), vq (blue triangles), do (red triangles), 
V\ (black crosses), or d\ (purple diamonds). When the coefficient of variation of the extrinsic 
variable changes, r is 10 3 s (a, c, and e). When r varies, the coefficient of variation is 1 (b, 
d, and f). Each simulation data point is calculated from 10 8 s of simulation. The dashed lines 
are analytical solutions using the unified colored noise approximation (applied to d±; c and d) 



(Jung and Hanggi, 1987 


Swain, 2004 


). The Lang( 



e and f) (van Kampen, 1990 



approximation and is unable to reproduce the shift in mean protein number. The unified colored 
noise approximation is non-linear, but is suitable for only one fluctuating variable and cannot 
be easily applied to the full model (Supplementary information). 
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Figure 3: Correlations between the the total noise in protein numbers and mean protein numbers 
and the total noise in protein numbers and the timescale of the extrinsic fluctuations. We 
randomly generated 10,000 sets of parameters for the model of gene expression in Fig. [T£i. We 
added extrinsic fluctuations to one randomly chosen parameter of the model (Materials and 
methods). Overall, the mean ratio of extrinsic to intrinsic noise in protein numbers is about 2. 
a The total noise and the mean protein number have a negative correlation of approximately 0.4 
for the entire dataset (red points and yellow crosses). The magnitude of this correlation increases 
to 0.6 for parameters where intrinsic noise is at least 50% of the total noise (yellow crosses). 
There is also a weak (approximately 0.3) correlation between the intrinsic and the extrinsic noise, 
b The total noise and the timescale of the extrinsic fluctuations have a correlation coefficient 
of approximately 0.35 for the entire dataset (red points and green crosses). This correlation 
increases to 0.6 for parameter sets with extrinsic noise at least 75% of the total noise (green 
crosses) . 



14 




Figure 4: Extrinsic fluctuations can enhance the effects of negative auto-regulation on noise 
and response times. Proteins are repressors and can bind to the inactive promoter state in 
Fig. with a dissociation constant Kd- We let vq have extrinsic fluctuations with a coefficient 
of variation of 1. Intrinsic noise increases and extrinsic noise decreases as the strength of the 
feedback increases. The steady-state number of proteins drops from 1000 with no feedback to 
300 when the feedback is maximum, a For weak extrinsic noise (r = 10 3 s), the total noise 
mostly increases with feedback strength, b For strong extrinsic noise (r = 10 4 s), the total noise 
mostly decreases with feedback strength. In both cases, there is an optimum Kd for which the 
intrinsic noise and extrinsic noise are equal and the total noise is minimum, c The response 
time distribution for constitutive expression: measuring from the initiation of transcription, t r 
is the time taken to first reach half of the mean steady-state number of proteins. Extrinsic 
noise (r = 10 4 s) decreases the mode of the distribution from 1800s to 1300s, while the mean 
increases from 2900s to 4700s. d The response time distribution for an auto-negative system 
(Kd ~ 60nM). Extrinsic noise (r = 10 4 s) decreases the mode from 300s to 200s. The mean 
increases from 1300s to 1900s. 



15 




10 10 10 10 

t (sec) t (sec) 



Figure 5: Non-specific effects of extrinsic noise: fluctuations can combine constructively or 
destructively when extrinsic noise is applied to two parameters in Fig. la. Let 77^ be the extrinsic 
noise when the parameter i fluctuates, and let 77^ be the extrinsic noise when parameters i 
and j fluctuate, a The relative extrinsic noise, {VeJ/ 1 ) 2 /[{Velt) 2 + {vixt) 2 ]^ when uncorrelated 
fluctuations are applied to a pair of parameters. The scale-bar shows the magnitude of the 
relative extrinsic noise: (77^? ) 2 ~ (?7ext) 2 + (vixt) 2 - b The relative extrinsic noise when correlated 
extrinsic fluctuations are applied to a pair of parameters: (rj^) 2 ^> (?7ext) 2 + (Vcxt) 2 or (VexP) 2 ^ 
(^ext) 2 + ivixt) 2 - c Total noise in a coherent feedforward loop versus the timescale of extrinsic 
fluctuations in the number of X proteins. The feedforward amplifies noise: extrinsic fluctuations 
in X combine constructively with those in Y. d Total noise in an incoherent feedforward network 
versus the timescale of extrinsic fluctuations in the number of X proteins. The feedforward loop 
attenuates noise: extrinsic fluctuations in X combine destructively with those in Y. In c and d, 
results for the feedforward loop are shown with blue squares and results for the equivalent 'open' 
loop are shown with red circles. In the open loop, X' has the same mean copy number as X, 
but uncorrelated extrinsic fluctuations. The coefficient of variation of the extrinsic fluctuations 
in X or X' is 1. The two protein inputs X and Y regulate the gene Z through an AND gate. 
Other types of feedforward or regulation give similar results. 
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